METHOD TO MEASURE THROUGHPUT EFFICIENCY OF 
LOW SPEED MODEM RELAY OVER PACKET NETWORKS 
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CROSS REFERENCE TO RELATED APPLICATIONS 



Not applicable. 



STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 



DEVELOPMENT 
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Not applicable. 



BACKGROUND OF THE INVENTION 

This invention relates to modem transmission over packet 
networks. In particular, the present invention relates to 
15 techniques for demodulating, relaying, and remodulating low speed 
(eg. V.22, V. 2 2 bis and V.21) modem transmissions over packet 
networks . 



20 they are not directly connected. The entire modem signal is 
packetized at a sending end, sent over the packet network and 
reassembled into a designated format at the receiving end before 
presentation to the receiving modem device. 



When modem devices are connected through a packet network, 



25 



For example, packetizing and transporting of modem calls 



over gateway platforms using G.711 (PCM) codec, requires 



digitizing the originating modem phone line at 64Kbps, 
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packetizing and transporting the entire 64 kbps data stream to 
the other side, and then sending out the same 64 kbps data stream 
to the remote modem. The advantage of this approach is that it 
works for any modem that can be received on a standard POTS phone 
5 line, and it is simple to implement. 

The disadvantage of this approach are: 

(1) it requires a large amount of network bandwidth to 
implement the call and a connection can be dropped because of 

10 packet loss. If G.711 packets are being sent every 10 mSec, 
q then the network bandwidth required to send each direction of the 

Jj call is over 110 kbps (when the header sizes 

(RTP+UDP+IP+TCP+Ethernet) are included) . 

(2) The connection over a packet network is not a constant 
Ul 15 connection and often experiences line delays, errors, jitter 

M= and/or packet loss which can result in modem errors. In 

nj particular, packet loss results in interruptions in the modem 

p signal (intermittent carrier loss) at the receiving modem. The 

O 

interruptions result in degraded data throughput due to modem 
20 retrains and increased modem connection failures. 

(3) Due to the clock differences at the two end points, 
standard G.711 playout techniques will periodically exhibit a 
modem signal interruption due to playout overruns and/ or 
underruns. Again these interruptions in the modem signal lead to 

25 periodic modem retrains impacting data throughput rates. 
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In summary, when G.711 coding with packetization is used for 
data modem transmissions, the two modems are essentially 
communicating to each other using a potentially inadequate medium 
for their transmission. This approach is particularly 
5 vulnerable to network packet loss. 



SUMMARY OF THE INVENTION 

The modem relay of the present invention allows for the 
capability to demodulate, relay, and remodulate modem 
10 transmissions over packet networks. 



The modem relay provides a local interface to the modem on 
both ends of the call, demodulates the full duplex data stream, 
packetizes the bits for transport over an IP network, and 
15 remodulates the data stream at the remote end. The modem relay 
provides bandwidth savings, and improved performance (data 
throughput and connection reliability) in a packet loss 
environment . 



20 The modem relay mitigates the problems associated with using 

G.711 to send modem traffic. In modem relay, the physical layer 
or link layer of the modem signal is terminated locally for both 
ends of the call. Only the demodulated data stream is sent over 
the network. This leads to dramatic bandwidth savings. For a 

25 V.34 modem, in an exemplary embodiment, the 64 kbps phone line is 
demodulated into a maximum of 33,600 bps data stream. That data 
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stream is packetized and transported with a network bandwidth of 
less than 20 kbps (for 30mSec packets) . 

Since the physical layer is terminated locally, network 
packet loss will not result in any interruption in the modem 
signal at the receiving modem. Therefore this approach will 
eliminate connection failures due to the network packet loss. 
Instead a packet loss will result in an error in the information 
data stream. 

Bandwidth savings are also realized using Modem Relay in 
that data is carried over the IP network only as the modem 
transmits data. When the modem is not transmitting data, no 
packets are sent on the IP network. In contrast, continuous 64 
kbps packetization takes place when using G.711 to carry modem 
traffic. Depending on the network transport, the modem data is 
sent over the packet network using a guaranteed delivery 
mechanism (link layer termination) or sent using a non-guaranteed 
delivery mechanism (physical layer termination) . In the case of 
a non-guaranteed delivery mechanism, data redundancy techniques 
can be used to combat packet loss and improve data throughput. 




BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of 
invention, reference is had to the 
description, wherein like elements 
5 numerals, and wherein: 




the nature of the present 
following figures and detailed 
are accorded like reference 



Figure 1 is a diagram illustrating the components of a modem 
relay configuration. 

10 Figure 2 is a diagram illustrating a point-of-sale 

implementation of the present invention. 

Figure 3 is a flow decision diagram illustrating the 
decision sequence for determining the modulation and connection 
15 speed. 

Figure 4 is a logic diagram illustrating an exemplary logic 
structure for modem identification and modem relay activation. 



20 Figure 5 is a logic diagram illustrating an alternative 

logic structure for modem identification and modem relay 
activation. 



Figure 6 is an exemplary implementation of a DSP voice 
25 channel configuration. 
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Figure 7 is an exemplary modem relay DSP configuration. 

Figure 8 is functional block diagram of an exemplary modem 
relay unit. 

5 

Figure 9 is a ladder diagram illustrating the establishment 
and negotiation of a connection using V. 22 bis modems. 

Figure 10 illustrates a typical IP packet for the present 
10 invention. 

t\ Figure 11 illustrates an exemplary MRU packet format of the 

%l MRU pay load within the RTP packet of the present invention. 

y = 15 Figure 12 illustrates the modem relay protocol state 

^ packets, modem handshake state packets and modem data packets. 

O Figure 13 is a block diagram illustrating a system for 

Q 

measuring the throughput efficiency of a modem relay transmission 
20 over a packet network. 

Figure 14 is a graph of packet loss and/or delay with 
respect to throughput as determined by the throughput analysis 
technique taught in the present invention. 

25 
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DETAILED DESCRIPTION OF PREFERRED EXEMPLARY EMBODIMENTS 

The modem relay for V.22bis modems and below occurs at the 
physical layer. The modem's physical layer is demodulated into a 
bitstream and that bitstream is relayed end-to-end across the 
network. Any higher layer protocols (error correction, 
compensation) that may be present are passed end-to-end across 
the network. 

A typical modem relay system configuration is illustrated in 
Figure 1. For lower speed modems, a typical end-user 
application is in point-of-sale terminals used to implement 
credit card validation. Figure 2 illustrates a point-of-sale 
implementation using modem relay. 

The steps in setting up a modem relay connection are: 

1) A first user, initiates a modem call using a dial-up 
modem, such as modem 2 attached to a personal computer 1 or in a 
point-of-sale terminal 20, at the first end of the connection. 

2) Modem 2, enters an off-hook state, dials and waits for 
the far end modem 14 to answer. 

3) The first gateway 3 detects the line seizure, opens a DSP 
voice channel and collects DTMF digits. 

4) The first gateway 3 translates the dial number and 
attempts to perform a call setup to the far end gateway 9 which 
is located at a remote point in the network. 

5) Gateway 9 detects the incoming call setup from gateway 3 



over the packet network 8. The gateway 9 accepts the incoming 
call and opens a DSP voice channel to handle the incoming call. 
Next, gateway 9 seizes the outgoing line. 

6) For modem relay, the outgoing line connects to modem 14 
at the far end which may be connected to a personal computer 15 
or may be a modem in a modem pool 24. Modem 14 goes off-hook and 
plays a modem answer sequence (eg. V.25 ANS tone). 

7) Gateway 3 detects the modems answer sequence (as 
described below) and switches the DSP over from a voice channel 
to a modem relay channel. Then gateway 9 sends the switch over 
message to gateway 3 in the form of a modem relay message packet. 
Gateway 9 also continues to negotiate with far end modem 14 to 
establish a data connection to PC 15. 

8) Gateway 3 switches its channel to modem relay and begins 
to negotiate channel setup with modem 2. 

9) During the negotiations, control messages are exchanged 
between gateway 3 and gateway 9 to coordinate the compression 
format used on both sides of the link and to establish the 
gateway to gateway LAPM link. At the end of the negotiation, 
both modems have connected with their respective local gateway at 
the best possible connection rate using V.42 LAPM and the same 
type of compression. Further, the modems on both sides have 
transitioned into data mode and are ready to begin sending or 
receiving data. 
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10) Modem 2 and modem 14 now begin sending data back and 
forth across the packet network 8. Each gateway unit demodulates 
the modem transmissions, packetizes the data and sends it to the 
far side. The gateway on the far side remodulates the modem data 
and sends it to the far end modem. Throughout the connection , 
flow control is performed on each segment of the link to regulate 
the error free transmission of data. 

11) The connection continues until one of the modems hangs 
up. At that point, the call is terminated on both sides and the 
channels then return to idle. 

Throughout a modem relay call, the state machines in the 
modem relay unit periodically send line status updates to make 
sure that both modems remained in sync with each other. 

The operation of modem relay is driven by events that occur 
when gateway 9 seizes its outgoing line and places a call to 
modem 14. Initially gateway 9 does not know that the call is a 
modem call, and begins by using a voice processing configuration 
in the DSP 13. When modem 14 answers, it begins play out of a 
V.25 answered tone (ANS) , as illustrated in Figure 3. 

When modem relay is enabled, gateway 9 switches to the low 
speed modem relay DSP code after it detects the V.25 answered 
tone, and proceeds to monitor the incoming sequence from modem 
14. Gateway 9 attempts to establish a V.22bis, V.22 or V.21 data 



connection. Depending on the type of modem on the line, the 
decision sequence illustrated in Figure 3 is executed to 
determine the modulation and speed for the connection. If a fax 
signal is detected, the modem relay code sends a message to the 
microprocessor code to perform a switch to fax relay. 

At each stage of the negotiation process, gateway 9 will be 
sending signaling messages across the network to gateway 3 . 
Because there is no guaranteed method of flow control between 
lower speed modems, both sides of the connection must be trained 
to operate at the same modulation and rate. Therefore, signaling 
messages are used to determine if the capabilities of the two 
modems can support an optimal connection. If there is a 
capability overlap, the best commonly supported data rate will be 
selected at both sides. If there is no modulation and rate 
common to modem 2 and modem 14, then the call will be a connected 
independently at both sides. These "uneven" connections work, 
but not as efficiently as connections that support the same data 
rate at both ends. 

For V.32 modems and above, V.42 error correction is 
frequently used to provide link layer connectivity and error 
correction between the two modem and points. For V.22bis modems 
and below, V.42 error correction may or may not be present in the 
connection. 
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For V.22bis modems and below, if V.42 is present, it is 
handled transparently by passing error correction end-to-end over 
the network. Therefore, both modems have to be synchronized at 
the start of the call to use the same modulation and data rate* 
5 Then, V.42 and other high layer protocols are simply ignored by 
the modem relay software. This approach will work provided that 
network end-to-end delays do not exceed one second. If the 
network delay exceeds one second, then the modems will be able to 
connect to each other but not be able to establish LAPM protocols 
10 across the link, which will increase the error rate and prevent 
p data compression (V.42 bis) for the modem session. 

01 

^ There is currently no network protocol standard defining the 

~ call control or data transmission protocol for modem relay over 

y - 

yi 15 packet networks. Therefore, a proprietary approach is utilized 

^ by the present invention to implement modem relay. However, the 

jfi i 

ru present invention can be implemented with a standard protocol 

O without departing from the scope of the inventive concepts taught 

herein. The protocol is similar to the proprietary fax relay 
20 protocol disclosed in co-pending application 09/031,047. The 

modem relay protocol used accommodates encapsulation using the 

RTP format for transmission across the network. 

The modem relay protocol has the following features: 
25 Redundant Signaling Messages - There are two types of 

signaling messages: call control and modem control 
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signaling. Once a modem call is established, the only call 
control message that is expected is a termination event. 
Modem control messages including events like forced 
retraining or carrier loss events. All of the signaling 
messages between the two gateway units 3 and 9, are sent 
periodically throughout the call by the modem relay unit. 
They are sent more rapidly during call setup and 
negotiation. A signaling message is contained in a single 
modem relay packet, which conveys the current state of the 
call. If the network drops any one signaling packet, 
another packet will be sent soon so that the call can still 
proceed normally. If there is a network outage during a 
modem call that interrupt the packet flow between modem 
relay units, each side of the connection will perform a 
clear down on its part of the call. 

Redundant data. Instead of sending the same packet 
several times, data redundancy is achieved by appending data 
from previous packets in the payload section of the current 
data packet. Then, the receiving gateway uses the packet 
sequence number to determine if there has been a packet 
loss. If no packet loss occurred, it uses the most recent 
data field in the packet. If the receiving gateway detects 
that packet loss has occurred, the data fields for lost 
packets are retrieved by reading further down in the current 
packet. Data redundancy effectively increases the network 
bandwidth, though the actual data from the modem is a small 
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part of the overall packet size. For instance, in a 2400bps 
modem with a lOmSec VIF size, the data size is 3 bytes and 
the header size is 48 bytes per network packet. Adding in 
additional 3 bite data fields will not increase the overall 
5 packet size by a significant amount based on a percentage of 

the total size. The amount of redundant data contained in 
each packet is configurable. 



Retraining is also accommodated by the present invention. 

10 In the event that one of the modems in the connection experiences 
a loss of equalization on the line, it can initiate a retrain 
signal. When a gateway receives the retrain signal, it executes 
the retraining sequence locally and sends the retrain signal 
across the network to the other gateway. Both sides of the 

15 connection are negotiated to support the best case common rate. 



Since the retraining and rate signaling events may not be 
supported by one of the modems in the connection, a potential 
system problem occurs when one side initiates a retrain. The 
20 significance of this problem will depend upon the modem 

capabilities. If both sides of the call cannot be read trained 
to the compatible rate, the call will be terminated and cleared. 



Call discrimination is accomplished through processing in 
25 the DSP. When a call is connected, the gateway must determine 
what type of call processing is required to successfully 
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implement the call: voice, fax relay, modem relay, or PCM. 
Individual channels can be pre-conf igured for a certain type of 
processing, but in general the gateway does not know in advance 
what type of devices are going to be involved in the call. The 
earlier it can distinguish the type of traffic involved in a 
call, the faster it can switch over to use the right set of 
processing resources. 

Figures 4 and 5 illustrate alternative embodiments for the 
decision tree for determining the processing sequence for new 
calls. Initially, the originator places a call were the packet 
network. Upon detecting a call, the answering gateway sees the 
line and goes off hook. The answering gateway then determines if 
a V. 25 answer tone (ANS) with phase reversal, used by V.32, V.22 
and V.21 modems, is present. When detected on the answering 
side, the gateway will switch to modem relay processing. 

If phased reversal is not present, the ANS is the basic V. 
25 answer tone used by fax machines and V. 32, V. 22 and V. 21 
modems. When detected on the answering side, the gateway will 
switch to modem relay processing is the channel is preconf igured 
for modem relay and will not switch if the channel is potentially 
expecting fax transmissions. In the event that no ANS tone is 
detected, the answering gateway will then check for V. 21 flags 
which is the queue to switch to fax relay processing. The if no 
events are detected, the gateway will to continue to process the 
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call using voice codec. 

Most of the functionality required to implement modem relay 
is located in the DSP software of the gateway. Figure 6 
illustrates a standard DSP voice channel configuration. When 
added, the modem relay unit, MRU, is added as a processing lock 
in the DSP software, figure 7. Modem relay channels are added to 
the DSP system integration unit SIU. Modem data pumps are added 
to the DSP software. Modem relay encapsulation and protocol 
functions are added to the MRU DSP software and MRU configuration 
and statistics commands are added to the SIU. 

The microprocessor of the gateway also needs to be modified 
to accommodate the modem relay processing requirements. The 
microprocessor must respond to messages from the DSP that 
instruct the microprocessor to switch over from a voice channel 
to a modem relay channel in the DSP. The microprocessor must be 
able to respond to modem relay packets arriving from the network 
by switching a voice channel to a modem relay channel in the DSP. 
The microprocessor must allow the operator to configure and query 
statistics on a modem relay channels and must extend the NMM 
operator command set to accommodate commands needed to implement 
modem relay. 
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The SIU handles control and status messages from the 
microprocessor that reference to channel as it does for other 
types of DSP channels. Messages from the microprocessor that are 
unexpected or not supported in modem relay mode will be returned 
with an error code. 

Within the MRU, figure 8, is the functional software for 
modem relay. The structure of the MRU includes a modem driver 
connected to the PCM interface, a modem relay protocol unit and a 
modem network driver which connects to the network interface. 
The modem driver provides the interface between the PCM interrupt 
routine and the modem data pump, which performs the physical 
modulation and the modulation functions of the current modem. 
The modem relay protocol module tracks the modems control and 
state machine functions and provides both data and messaging 
queues and overflow buffers. It also formats the modem data and 
signals into the proprietary modem relay protocol. The modem 
network driver performs the RTP encapsulation functions to 
implement the modem relay protocol containing signaling messages 
and data. It also provides a jitter offer to compensate for 
network delays. 

The establishment and negotiation of a connection using V. 
22 bis modems is illustrated in the connection ladder diagram of 
figure 9. The modems will establish and negotiate a connection 
between the two gateways using the gateway communication messages 
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to coordinate the modem sessions. As illustrated, the call is 
initially established as a voice call until the tones to 
establish modem relay are detected. The modem relay units 
exchanged a handshake, and appropriate connection is negotiated 
5 the modem relay units contact and then establish relay states for 
beginning the modem data over IP communication. 

In order to properly implement a modem relay, is necessary 
to establish packet izat ion parameters as well as modem functional 

10 parameters such as modulation and rate. The approach of present 
invention defines the modem relay unit packet format to be 
encapsulated by RTP packets for use by compatible gateways with 
modem relay units. In order to establish and maintaining a modem 
connection over a packet network, the originating an terminating 

15 gateways must have a common modem relay unit packet format. The 
packet, figure 10, transported over the digital packet network, 
consists of a sequence number, kind stand, modem handshake, modem 
relay protocol and modem data depending on the process modem 
relay state. The packet format is illustrated in figure 10. 

20 

Figure 11 illustrates the MRU packet format of the MRU 
payload within the RTP packet. The illustrated exemplary 
embodiment illustrates and a bit payload with redundancy. 
Because the modem relay unit the present invention maintains the 
25 modem connection with the modem at each end of the connection, 
the data can be packet i zed into a packet with a standard RTP 
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header and time stamp. The following the RTP header , blocks 25 
in figure 11, is a field indicating the MRU protocol version. 
Identification of protocol version allows for better capabilities 
match and backward compatibility for more recent protocols. The 
5 digital fields in the packet include protocol state packets, 

handshake state packets and data as the exemplary packets in the 
present invention. Other protocols said packets can be included. 
The modem relay protocol state packets, modem handshake state 
packets end modem data packets are illustrated in Figure 12. 

10 

In addition to establishing protocols for packetization, 
protocols for a method for established communication across a 
packet network between modem relay units, must also be 
established. Once a call is established across a network was 
15 acceptable network delay and packet loss in the modem data pumps 
of the modem relay units begin the handshake routine two from the 
respective local modems. The modem data pumps are also able to 
report local connection and cure loss information to the modem. 

20 Once a call is established across a network, both modem 

relay units send a modem relay handshake message packets to the 
other modem relay unit. The initial packet contains the 
information of supported a modem rates. The need is repeated 
every 50 milliseconds to overcome packet losses. As soon as the 

25 first message is sent over the network, a timer is set to 5 

seconds and started. The modem data pumps are maintained a idle 
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during the handshake phase. 

The MRU's send handshake message packets to each other. The 
packet contains information of supported modem rates as bit 
maskes. The message is repeated every 50 milliseconds to 
overcome packet losses. As soon as the first message is sent 
over the network, a timer is set to 5 seconds and started. The 
modem data pump is maintained off. When the handshake message is 
received the rate bit mask is added with the local rate bit mask. 
The highest speed is chosen from the resulting value and 
handshake is initiated with the local modem. The modem data, 
will be started and connected at the best possible data rate. 

If the handshake message is not received, then the timeout 
occurs and highest speed is chosen from the local rate bit mask. 
The hand shake is initiated with the local modem and the modem 
data pump is started. 

As soon as a local handshake is reported, the modem relay 
unit will send the connect message packet to the other side. 
This message is also repeated every 50 milliseconds to overcome 
packet losses. When the connect message is received, the 
receiving MRU sends the reply message packet to the other site 
and continues to communicate with data packets. In the reply 
message is for acknowledgment purposes and is not repeated. When 
a carrier loss occurs, the modem relay unit will send the carrier 
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loss relay message packet to the other side. This message is 
repeated every 50 milliseconds to overcome packet losses. When 
the MRU connect message is received, the MRU sends the MRU relay 
message packet to the other side and continues to communicate 
with data packets. This message is for modern purposes and will 
not be repeated. 

When the MRU connect message in received, the MRU sends the 
MRU relay message packet to the other side, and continues to 
communicate with data packets. When a carrier loss occurs, the 
MRU will send the carrier loss message to the other side. When a 
user intervenes to stop the MRU the offline message is sent to 
the other side. In either the offline or the carrier loss 
message is received, the MRU will stop the data pump and inform 
the user. 

The efficiency of transport of packets over a packet network 
for a modem relay of the present invention can be affected by 
number of factors. The present invention teaches a system for 
measuring the throughput efficiency of a V.22bis modem relay 
transmission over a packet network, Figure 13. In order to 
perform the method of determination as taught herein. 

In order to practice the method for measuring throughput 
efficiency taught in the present invention, each gateway in the 
connection utilizes a modem relay unit as taught in the present 
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invention to connect its local modem to the network. The 
throughput efficiency can be measured after the modems have 
negotiated the appropriate protocols and have passed to the stage 
where a steady-state connection over the packet network is 
5 established. 



A computing device 34, as illustrated in Figure 13, is 
connected to each of the two modems. The connection can for 
example be through a standard serial or parallel port to receive 

10 information from each of the modems. The computing device 34 
runs two terminal programs, one for each modem. Each terminal 
program runs a Z-modem protocol and generates a modem data stream 
at a known throughput rate. The computer 3 4 is aware of the 
generated rate at each end of the modem relay communication and 

15 the received rate and can assess the throughput rate by comparing 
the modem data stream generation rate to the modem data stream 
reception rate. 



If the throughput efficiency measurement method is used 
20 across an existing network 35, the analysis will provide an 
indication of the throughput across that network. However, a 
network simulator 36 can be utilized in place of an actual 
network. The use of a network simulator 36 allows for control of 
parameters such as packet loss and delay for evaluation of modem 
25 relay implementation. For example, the simulator 36 can vary 

packet loss to any desired percentage. The simulator 3 6 can also 
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very packet delay to any desired delay time. The network 
simulator can also provide uniform distribution of packet loss 
and/or delay or can provide randomly distributed loss and delay. 

When implemented using a network simulator, the modem relay 
throughput efficiency measurement method of the present invention 
can be used to evaluate different software algorithms within an 
MRU of a gateway while maintaining fixed network conditions to 
provide a common reference. Measurement of throughput efficiency 
under fixed network conditions allows for implementation of 
appropriate redundancy techniques which minimize the loss of 
connection and the need for retrains while maximizing throughput 
by reducing excess redundancy. 

In evaluating the throughput efficiency, a number of files 
are transferred across the MRU's using the terminal program and 
Z-modem protocol of the computing device 34. The average 
throughput after a series of iterations of file transfers is a 
logged for each file type and an overall throughput efficiency is 
determined. For example, a set of files such as the following 
could be used for testing and evaluation. 

An ASCII file with ASCII characters only, a C source file, 
a combination composed of equal portions of repetition, ASCII, 
random and a section of continuous blanks, a valid DOS executable 
program file, a file of repeated ASCII sentences, a valid ASCII 
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graphic (AutoCAD) file, a random binary file, and/or a valid 
spreadsheet file. 

In an exemplary embodiment, each file length is 42 kB and 
length. The file length illustrated is for exemplary purposes, 
in any given implementation of the invention, the file length can 
be any appropriate size. The Z-modem file transfer protocol 
throughput values are collected and the average of the collected 
values is calculated. Two tables are prepared with the x-axis as 
packet loss or delay and the y-axis as throughput, Figure 14. 
The designer can then select the best tradeoff of packet loss and 
delay in designing a modem relay system. 

Because many varying and different embodiments may be made 
within the scope of the inventive concept herein taught, and 
because many modifications may be made in the embodiments herein 
detailed in accordance with the descriptive reguirements of the 
law, it is to be understood that the details herein are to be 
interpreted as illustrative and not in a limiting sense. 



